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PREFACE 


This  work  is  an  expanded  version  of  a  set  of  lecture  notes 
corresponding  to  a  course  given  by  the  author  during  the  period 
November  1978  to  January  1979.  Analytical  methods  for  the  solution 
of  moving  object  search  problems  are  developed  from  "first  principles 
This  work  complements  the  first  author's  CNA  memorandum^ (reference  1) 
£pbut  otherwise  there  is  little  overlap  with  the  existing  literature 
on  search  theory,re.g. ,  references  2,  3  ,~~a  nd~TT7'*  The  approach  taken 
is  tutorial,  in  that  the  solutions  of  harder  problems  are  motivated 
by  the  solutions  of  simpler  problems.  There  are  exercises  inter¬ 
spersed  throughout  the  work?  the  solutions  of  some  of  these  are 
given  in  the  appendix. 

This  work  is  concerned  with  mathematical  analysis  and  not 
with  modeling  target  motion  or  detection  functions  and  not  with  the 
development  of  computer  codes. 

Some  general  references  kre  references  2  through  7. 
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Appendix  A:  Solution  of  Exercises 


+<j+*'-i ,  <*  ••  '  ;•'•(  -:  »' -v-r.v,  •=:-•  .»•  •.,- . 


FORMULATION  OF  THU  SF.ARCI1  PROHLEM 

Tho  position  of  1  h<-  i. argot  .  1  h  time  t  will  be*  denoted  by 
X(t) .  It  is  a  vector,  so  that: 


X(t)  *  (Xj  (t) ,  x2  (t)  ,  x3 <t) ) 


(1.1) 


The  target  moves  in  some  region,  denoted  by  D^. 

The  position  of  the  searcher  at  time  t  will  be  denoted  by: 


Z(t) 


(Zj  (t)  ,  Z2  (t)  ,  7,^(1)) 


(1.2) 


The  following  inputs  are  needed  to  formulate  the  search  problem. 


INITIAL  DENSITY 

Let  Pq(x)  be  defined  by: 


nQ (x)dx 


Prf x]  a  X]  (0) 
x ^  a  (0) 


s.  x^  +  dx^,  x2  s  X 2  ( 0 )  £  x2  +  dx2, 
i.  x3  +  dx3 } 


(1.3) 


In  this  equation,  x  =  (x-j  ,  x2,  x 3 )  is  a  vector  and  dx 
Three  types  of  initial  densities  are  considered. 


dx2 ,  dx 


3) 


1 


Type  1 


Initial  density  concentrated  at  a  point.  Namely: 


Prob(X(0)  =  -  1  .  (1-4) 

Symbolically,  one  writes: 


Oq(x)  =  ( x - x 0 )  =  .\  (xt~xio) ,S  (x2~x20}  J"x3q)  ■  { 1— 5 ) 

In  this  equation,  MS)  is  the  "Dirac  Delta  Function"  (reference  8). 


Exercise  (See  Reference  8) 
One  definition  of  MS)  is: 

«<s)  =  llM  Jje-S*n/2 

n-''*-  f  2 7T 


(1-6) 


lim 

n-+o> 


Fn(SI- 


(1-7) 


Sketch  a  few  of  the  f,n(S).  Also  draw  6  (S)  ,  the  derivative  of  MS). 
Note  that  fi (S)  =0  if  S  /  0  and: 


(1-8) 

(1-9) 
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Type  2:  Nowhere  Va nishing  I niti a 1  Densi ti es 

In  this  cane,  ^ ^  ( x )  does  not  vanish  in  D^., 
of  such  an  initial  density  is  tho  circular  Gaussian: 


(,0 


(x)  = 


pj 

L^na  J 


V2  _r2/2(J2 

e 


where 


2  2  2 
r  =  (Xj  +  x2  +  x^! 


An  example 


Type  3:  Compact  Initial  Data 

In  this  case,  pg(x)  is  non-zero  in  some  subregion 

I 

Dt  C  dt  and  zero  elsewhere  (see  figure  1). 


TARGET  MOTION  MODEL 

The  velocity  of  the  target  is  V(X,t)  and  is  given  by: 


dX 

at 


V(X,t)  . 


The  increment  in  X  is  then  given  by  AX  *  V(X,t)At.  Introduce 
the  transition  function  (e.q.,  references  5  and  6),  q (f,  , t, At,x) 
defined  as  follows. 

Set: 

AX  -  X ( t+At )  -  X(t)  . 

Then,  the  transition  function  q(£,t,At,x)  is: 

qU,t,At,x)d£  =  Prob{£iAXsC+d£  |x(t)=x)  . 


(1-10) 


(1-11) 


(1-12) 


(1-13) 
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In  this  equation,  f.  =* 
The  right-hand  side  of 
Equation  1—13  can  also 


(r.  1 ,  ,f;2,  f3)  and  df,  =  \dr  x ,  d r>2,  dt3j. 
equation  1-13  is  satisfied  by  each  component. 

be  rewritten  as: 


q  ( ■ ,  ,  t ,  A  t ,  x )  d  \  «  Prob{  f.  s.  X  ( t+At)  -  X(t)  s  f,+df,  |x{t)  -  x}.  (1-14) 


Determinist.l c  Target  Motion 

In  the  case  of  deterministic  target  motion, 


q  (f,  ,t,At,x)  »  6  (r,  -  b(x,t)  At) 


(1-15) 


Namely,  wi'h  in  obability  1,  AX  *  b(x,t)At  .  Let  E{  ■ }  denote 
mathematical  expectation.  Then: 


E(  AX | X ( t) 


x  I  =» 


,t,At,: 

/ 


x)d£ 

r,6(r,  -  b (x, t) At) d£ 


-  b  { x ,  t )  A  t . 


(1-16) 


Hence,  one  writes  that: 


dX 
d  t 


b  ( X ,  t )  . 


(1-17) 
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Mil 


Exercise 


Show  t  ha*-  l  T  <  j  I  ,  I  ,  '  t  ,  v  )  i  •;  i  vimi  .  >y  •  gu.i  I  i  t  n  '!  I  ,  I  h>  ■!■  : 

Vai  :  '  \  |  X  i  (  )  u  . 

Conditional  ly  Deterministic  Target  Muliun 

In  thin  o.iae#  equal  ion  1  -  •  is  n'ldncvd  by: 

q  ( t\  ,  t. ,  At ,  x  )  --  .  .  p  >N  ( f.  -  l.t ' '  ( x  ,  t:  )  A  t, )  ,  (  i - 

1  t 

with  M  ;>  1  .  Numnly,  there  ni'f  numhn>*  of  possible  tnrciet 

u  (< 

f  ^ 

VO  loo  i  t  ica,  with  <i  probability  p  annuo  i.it.cd  with  velocity  b  (x,  t)  . 

If  the  velocities  arc*  con  t:  i  nuous  1  v  distributed,  then  • -qua  lion  1.-18 
must:  bo  modi  fled,  of  course. 

The  classical  example  of  conditions  I  I  y  do  to  run  i  ni  Stic  target 
motion  la  the  "fleeing  datum"  (see  reference  2).  in  this  case,  the 
target  flees  with  a  known  velocity  but  with  unknown  bearing. 


Stochastic:  Target  Mol  ion 

In  this  case,  one  assumes  t  hat,  given  v  <  t  ) 


then 


AX  =  X(t-tAt)  -  X  ( t. )  iR  normally  distributed  with  mean  h(x,t)At  +o(At) 


Without  losa  of  generality,  one  assumes  b(x,t.)  is  known  with 
complete  rer  ta  in  ty .  Only  a  small  modification  is  needed  to  use 

a  conditionally  deterministic  mean  lo  (  ( x ,  t: )  . 


and  covariance  matrix  (a.  .  (x,t).\t  +  o(a t))  .  Hero  o(At)  moans 
a  quantity  such  that: 

1  im  a  ( A  t )  „  0 

At-»0  At  * 

Alternatively,  one  writes  that: 

A 

E(AXi|X(t)  =  xl  -•  b  ^  ( X  ,  t )  A  t  t  o  (A  t)  i  1,2,3 

A 

Cov{  AX^AX..  |X  (t)  ~  xl  *  ,  (x  ,  t)  At  +  o(At)  . 


Exercise 
Show  that: 

A 

EUX^X  .  |  X(t)  -  xf  *  aij  (x,t)At  +  o(At) 


Exercise 

Let  AtlO  and  then 
c:,  t\  ,t,  At,x)  Cor  AX? 


A 

(aij)*0  . 


What  happens  to  the  density 


Exercise 

Restate  equations  1-20  and  1-22  in  terms  of  q (£ , t, At,x) . 


Remark i 


1.  Since  for  stochastic  target  notion 
A  A 

d  X  ~  N  ( b  ( x  ,  t  )  At:  +  o  ( A  t )  ,  .  t  ( x  ,  t  )  A  t  -i  o  (  A  t  )  )  ,  ( I  > 

satisfies  the  "I to  Equation"  dx  --  b(X,t)dt  +  .'a  ( X ,  t )  dW, 
v.here  W(t)  is  Brownian  motion. 


For  the  case  of  stochastic  target 
q  (r  ,  t,  At,x)df,  -  o  (At)  for  n  q 


motion 

3  . 


Exercise 

Demonstrate  Remark  2. 


SEARCH  FUNCTION 

The  final  input  is  the  search  function  (or  "conditional 
detection  function",  reference  9).  Let: 

A 

i|>(x,t,z)At  “  Probl  detection  in  (t,  t+At)  |  X  (t)  «x,  Z(t)*z}.  (1-23) 

This  function  must  be  modeled. 


8 


SEARCH  PROBLEMS 


The  following  quantities  are  of  interest  in  search  theory. 


Let: 


p(x,t|Z)dx  =  Pr{x  •-  X  ( t )  •  x  +  dx|search  along  Z(i), 

0  s  t  s  t  was  not  successful} 


To  obtain  p(x,t|z)  ,  consider  the  joint  density 


f(x,t;  Z)dx  *  Pr{x  u  X ( t)  s  x  +  dx  and  search  along  Z(t), 


0  s  t  s  t  was  not  successful}  . 


Since  Pr (A  and  B)  =  Pr (A | B) Pr (B) ,  one  has: 


p(x,t|a) - 

J f  (x, t; Z)dx 


D 


(1-24) 


(1-25) 


(1-26) 


Note  that  p(x,t|z)  and  f(x,t;Z)  have  the  same  spatial  dependence 
and  differ  only  by  a  function  of  time. 

A  related  quantity,  of  interest  in  "time-late"  problems,  is 
the  density  in  the  absence  of  search: 

p(x,t)dx  ■  Pr{x  £  X (t)  s  x  +  dx)  .  (1-27) 
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THE'  SEARCH  EQUATIONS 


£{x,t+At}Z)  =  (1  -  i|»At)  ^£(x,t;2)J  q(£  ,t,At, 

'  1: 3 ^7  't'At'x)d-) 


x)d£ 


rhust 


£  (x,t+At;Z) 


+  5  ax'^x"  (f/5i€jq(e,t,At'x)d5) 

+  y*0(C3)q(Pwt,At,x)de  +  o(At)  . 

a  (1  -  tp A t )  |f  (x,  t?  Z)  -  S  §“  ^bi  (x» fc)  At  +  °(At) 
+  o(4tl)  *  «««]. 


Equation  2-5  follows  from  che  definition  of  b(x,t)  and  a(x,t). 
Expanding  the  right-har.d  side  gives: 


f  (x,  t+At>  Z)  -  £(x,t?Z)  “  -ipfAt  -Hg-r  (bif)At 

i  l 


,  a2  A 

+  ir,  r-4r-  (a.  .f ) At  +  o( At)  . 


Dividing  by 

At  and  taking 

the  limit:  as 

A  t  4  0 

qivos  the  search 

equation : 

11 

1  v .  a 2 

^  •) 
'■'-n  'V  V 

A 

-  (to  P) 

! 

A 

„„  .j,r 

t 

I  n"xTax"T 

i  /  .1  i  i 

ip  i.  . 

(2-7) 


Equation  2-7  will  be  called 


the  stochastic  search  equation  (SHE)  . 


Exercise 

Suppose  that  there  is  no  search,  hot 

p(x,t)dx  -  Pr{  x  i.  X  ( L )  s  x  -t  d:<)  .  Show  that  p(x,t) 

satisfies  the  following  equation: 


;ip 

;7t 


A 

(b.f) 


(2-8) 


Exercise 

For  the  case  of  deterministic  target  motion,  show  that 
f(x,t;2)  satisfies  the  deterministic  search  equation  (DSE) s 


11 

at 


sa 


A 

O^f) 


A 

i|;  f  . 


(2-9) 
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Remark 


Define  a  flux  Ji(x,tjf)  bys 


JjL(x,t;f)  = 


.A  A  1 

-  -j;  ^  (aijf»  -  bi' J  • 


(2-10) 


Then,  the  SSE  (equation  2-7)  becomes t 


:!■ 


r!  +  gjdq  [Ji(x<t,f>] 


A 

-  Vj/f  . 


(2-11) 


This  is  a  conservation  or  continuity  equation. 


Now  consider  equation  2-7.  It  needs  boundary  and  initial  conditions, 

1.  Initial  Condition:  f  (x,  t  j  Z)-*-pQ  (x)  as  t+0  , 
where  pQ(x)  is  the  initial  density. 

2.  Boundary  Conditions  are  more  difficult.  Possible  ones 
are  i 

a.  f(x,t»Z)  ■  0  for  x  on  the  boundary  of  DT 
(i.e.,  an  absorbing  boundary). 

b.  The  normal  derivative  3f/3n  »  0  on  the  boundary 
(reflecting  boundary) . 

In  this  paper,  the  boundaries  are  simply  ignored.  ThiB 
leads  to  solutions  that  are  valid  far  away  from  the  boundary. 


*1 
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They  can  be  modified  t-.o  satisfy  any  needed  boundary  conditions 
(see  reference  11  or  1). 


Remark 

f  ( x ,  t; '/ )  does  not:  into*  irate  to  I. 
fn  fact., 


f  (x  ,  t ;  55 )  dx 


Probf search  up  to  time  t 
1 1  * }  0  C  G  l>  l  j  full  1  (hopefully) 


is  not 


THE  SCALED  SEARCH  EQUATION 

Let  T  ,  L  ,  b  ,  a  be  defined  as  follows: 
c  c  m  m 


T 


c 


L 


c 


a 


m 


b 


m 


a  characteriHlic  t  i  m>> ,  n .  a  .  ,  t  i  me  available  for  search 


a  characteristic  di stance ,e.n.  ,  distance  from 


center  of  ''q(x)  to  Lin-:  boundary 

A 

maximum  value  of  a  ,  .  ( x ,  t )  over  all  i , j 

A1- 

maximum  value  of  b.(x,t)  over  all  i*j. 


Now  define  dimensionless  variables  by: 

x, 


T  w 


i 


i  J 


m 


sa 


1 
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<  s> 


The  search  equation  2-7  takes  the  form: 


or 


_1  9_f 
Tc  3  T 


3  f 

57 


-5  ^  57TTU-  <a,,f)  -  fT  ^  5TT  (5if)  "  *f  ' 

L l  i,  j  9yi3yj  ij  Lc  i  3yi  1 


(2-12) 


amT 
me  v 


b  T 
me 


£  *  -Zf  \Wl  <Btf>  '  *V-  (2-l3) 


Mow  assume  that  T  .L  are  chosen  so  that: 

c  c 


Vc 


c  <<  1  . 


Define: 


A 

iJj  «  i)jTc 


(2-14) 


(2-15) 


The  final  non-dimensional  search  equations  is  (reverting  to  x,t 
instead  of  y,T  ): 


3  f 
St 


Sj  (aijf) 


^  (bif)  “  * 


(2-16) 


Remark 

When  e-»0  ,  equation  2-16  becomes  the  deterministic 
search  equation. 
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Remark 


It  has  boon  assumed  that,  and  t(j  are  quantities 

that  are  0(1)  ,  i.e.,  of  the  order  of  1.  Tt  could 
be  that  are  0(r)  ,  in  which  case  equation  2-16 

would  take  the  form: 


Of 

cTE 


F[i7l  3x"i5*j  (aiif>  ~  X  3*i  {bif)] 


ijif 


(2-17) 


For  purposes  here,  equation  2-16  will  be  used  instead 
of  equation  2-17. 

Remark:  An  Alternative  Formulation  for  e 
Suppose  that  the  initial  data  were: 


1  exp 


(xj*xj) 


2  n  a 


Under  the  scaling 


2o 


T 


one  obtains: 


^0 


2  ira‘ 


exp 


,2  2,  2 

(yi+y2)r'c 

- 9 - 

2a 


16 


-m 


% 

v, . 

’I  -t 
F 


1 


!  } 


If  cj2/2L2  <<  1  ,  then  an  alternative  definition  of  e  could  bet 
c 


In  this  case,  (a^)  and  b{y,t)  would  have  different  interpretations. 
Remark 

One  could  imagine  that  b(x,t)  in  equation  2-16  is 
not  known  with  complete  certainty,  but  that  b(x,t) 
is  known  in  a  conditionally  deterministic  fashion.  In 
this  case,  one  solves  an  equation  of  the  form  of 
equation  2-16  for  each  possible  b(x,t)  and  then 
averages  over  a  . 
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SOLUTION  OF  THE  DETERMINISTIC  AND 
CONDITIONALLY  DETERMINISTIC  SEARCH  EQUATIONS 


References:  14,15, 


The  deterministic  search  equation  is: 


3f 

3t 


v  JL-  (b.f) 
i-l  f1xi  1 


ip£  , 


(3-1) 


with  initial  data: 


f  (x,  0;  2S)  - 


p0 (x) , 


(3-2) 


and  no  boundary  data. 

In  order  to  solve  equation  3-1,  the  method  of  characteristics 
is  used.  Rewrite  equation  3-1  as: 


3ff 


+ 1:  b 


af 


at  ^  i  ax. 


•(♦ +  s  k) 


(3-3) 


Introduce  a  new  variable  S  so  that: 


w  *  1 


(3-4) 


and  set: 


dxi 

~<JS 


*  b 


i  ^x,  t(S)j  . 


(3-5) 


\ 
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\ 


\ 


Choose  initial  conditions  bo  that: 


t  «  0 


Xi  -  xi0 


when  S  ■  0 
when  S  -  0 


The  solutions  of  equations  3-4  and  3-6  give  a  "curve"  (or  space 
time  ray)  in  0^.  From  equation  3-3: 


df  „  3  f  dt  .  v  3f  i 

3s  3tds  +  “ 


3 f  ,  s,  K  3 f 

“  3t  “  Di  3xJ  * 


Thus,  on  the  solution  curves  of  equations  3-4  and  3-5, 


»  m 

-  ij^x(S),  S,  Z(S)^  +  £  J^”(X(S)'S)  f 


with 


p0(xo> 


when  S  ■  0 


(see  figure  2)  . 


Formally,  one  can  write: 


f (x, t; Z)  -  p  0 (Xg) exp 


[-/( 


*  +  s  5x7  ) ds 


(3-6) 


(3-7) 


(3-8) 


(3-9) 


(3-10) 


(3-11) 


/ 


/ 


/ 


FIG.  2 x  SOLUTION  OF  THU  DETERMINISTIC  SEARCH  EQUATION 
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In  using  this  formula,  one  writes: 


x^(t)  «  x 


to  "X  bi'x,R 


c^(t)  -j  b^(x,S)dS 


This  form  is  especially  useful  when  b  is  independent  of  x.  In  that 


case: 


xQ  -  x  -  I  b  (S)  dS 


EXERCISE  (A  CASE  WHERE  EQUATION  3-13  IS  USEFUL) 

Suppose  that  b^  -  v^ft)  ,  independent  of  x  .  Show  that: 


f (X, t; Z)  -  o, 


/ 

x  -  /  v (S)dS 
•'O 

■  « 

-/  *[■  -/ 

J  0  •'S 

In 


(S')dS',  S,  Z  dS 


Write  down  the  integral  that  gives  the  probability  of  detection 
by  time  t  . 


Remark 


Note  that  equations  3-11  and  3-14  can  be  summarized  as: 


f  ~  [It*™  due  to  target  motion[]xQterm  due  to  search^  , 


-  -iRj  SR 


COMPUTATIONAL  ALGORITHM  FOR  DETERMINISTIC  TARGET  MOTION 


StCD  1 


Pick  x. 


(  v  v  v  \ 

If]'  "  If'  ' 


Solve  -  1  i  r  t  >  ;  >H(0)  "  *j.O 


Step  3 


Solve 


'("  +  Y  5)  e 


f(0)  -  o0(x0). 


Cycle  (i.e.,  pick  a  different  y,n  and  r turn  to  step  1)  . 


COMPUTATIONAL  ALGORITHM  FOR  CONDITIONALLY  DETERMINISTIC  TARGET  MOTION 
In  this  case 


b(x,t)  «  ba ( x  r  t ) 


with  probability  p  .  Lei.  f  (x,t;S5)  satisfy 


'  $bL  (b'if,t)  -  *f' 


(3-16) 


f  (x,  0?  K)  =»  pQ  (x)  . 


(3-17) 


(3-18) 


xEu.V.  . . .  ....  -  .  .  LjL*A^,cI 


,  the  following 


In  order  to  determine  f(x,t;Z)  *  Ea(fa(x,t;z)  } 
computational  algorithm  can  be  used. 

Step  1 

Fix  ba(x,t)  (with  probability  pa) . 

Step  2 

Pick  Xq  -  (x10,  x20,  x30) 

Step  3 

dxi  a 

Solve:  -  b^Xft)  >  x^O)  *  xi0  * 

Step  4 

j  fQt  /  3b?  \ 

Solve:  |£-  -  f“(0)  -  P0<*0>  . 

Step  5 

Cycle  ro  step  2  as  desired. 

Step  6 

Cycle  through  ba(x,t) 

Step  7 

Construct:  f(x,t;Z)  -  E  {£a (x, t ? Z) }  . 

U  \ 
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ALTERNATIVE  COMPUTATIONAL  ALGORITHM  i 
Step  1 


Fix:  x. 


(X10'  X20 '  X30) 


Step  2 


u) 


Fix:  bra{x,t) 


Step  3 


dx 


V-i/V  , 

Solve:  -gpg  “  b“(x,t) 


Xi(°)  -  xi0 


Step  4 


Solve : 


df  01 


Step  5 


Cycle  through  b“(x,t) 


Step  6 


Construct:  f(xrt;Z)  ■  E  {f(xrt;Z)} 

Ct 


Step  7 


i-  toll  o;t  ft! 

:  1 1 "  :i 

'  t 


.r- 


! 


■Ji 


Cycle  through  xn  . 


SOLUTION  OP  THE  STOCHASTIC  SEARCH  EQUATION 
IN  SOME  SPECIAL  CASES 

General  References:  6,  i3,  15,  16,  17,  18. 


In  order  to  motivate  the  solutions  constructed  in  the  next 
section,  certain  special  cases  are  studied  in  this  section,  study 
of  such  canonical  problems  (see  reference  16)  has  been  very  useful 
in  other  disciplines. 

First  consider  the  stochastic  search  equation: 


3  f 
5t 


2  e 


7  ax^Xj 


“V> 


(b1f)  -  (if  , 


with  the  following  assumptions: 


(4-1) 


if  i-j 
otherwise 

A2)  b^(x,t)  ■  b^  a  constant  independent  of  position 

and  time. 

A3)  The  target  moveB  in  the  plane. 

A4)  i|j(x,tjZ)  -  $  ,  a  constant. 


Al) 


‘ij 


*  6 


ij 


The  search  equation  is  then: 


(4-2) 
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with 


f  (x,0;Z)  ■  pq(x) 


(4-t) 


Exercise 


Show  that  if  one  sets  f(x,t;Z)  ~  w(x,t)e”^jt  ,  then: 


aw 

at 


e  fa 2w  ,  a 2w  1  Ik  aw  .  .  aw  1 

t?2  \  n  ~i  *  b*>-2  \ 


with  w(x,0)  a  p  q (x ) 


CANONICAL  PROBLEM:  TYPE  1  INITIAL  DATA 
Assume  that: 


(4-4) 


P  0 ( x )  «  6 (x) 


(4-5) 


i.e. ,  Pr{X (0)  -  0}  -  1  . 

Then , 

w  (x ,  t)  *  -* — 


(Xh -b, t) 2+ (x9-b~t) 2  n 

^  expj. , - 


(4-6) 


The  right-hand  side  of  equation  4-6  is  the  Green's  function,  G(x,t)  , 
or  fundamental  solution.  As  t+0 


w  (x » t)  •*  6  (x  )  a  (S(X1)6(X2) 


(4-7) 
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Exercise 

Show  that  equation  4-6  satisfies  equation  4-4. 


CANONICAL  PROBLEM :  GENERAL  INITIAL  DATA 
Assume  thatt 

pQ(X)  -  pfXjyXj)  . 

Then  (see  references  5,  14,  or  15) 


w(x, t) 


■  G  *  p 


t,  t)p0(Od£  . 


Exercise 
Assume  that! 

1  (  xl+x2 

p°(x)  ’  S  -IT" 

Find  w(x,t) . 

Hint i  GaussiaA  functions  are  closed  under  convolution 
(complete  the  square) . 


(4-8) 
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CANONICAL  PROBLEM:  TYPE  3  INITIAL  DATA 


Assume  that: 


P«(x) 


p(x)  in  square  of  side  21 

0  outside 


(4-9) 


Then: 


l  y.  I 


w(x,t)  « 


//- 


(x  -  f, ,  t)p(Odf, 


(4-10) 


Remark 


The  one-dimensional  analogue  of  equation  4-9  is: 
P0(x)  - 


P  (x) 
0 


-!/,  £  X  t  i 

otherwise  , 


(4-11) 


and  of  equation  4-11,  is 

w(x,t)  -  — - —  f  p  (5 ) exp F-  ^ . 2et^'"”’  1  ^  ' 

/2lTf:t  -l  L  J 

(Hard)  Exercise  (see  references  17  and  18) 

Use  integration  by  parts  to  develop  an  asymptotic  expansion 
of  equation  4-12  valid  for  small  £  and  I  (x— bt)|  < 
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Remark 


All  of  the  above  resultB  also  hold  when  b^(x,t)  »  b^(t) 
only,  independent  of  x  .  In  this  case,  the  Green's 
function  G(x,t)  1st 


(4-13) 


CANONICAL  PROBLEM:  NONCONSTANT  £ 

Allow  ip  to  vary,  but  keep  all  the  other  assumptions.  The 
search  equation  can  be  rewritten  as: 


e 


a2f 

- K 

3Xj 


b 


af 

1  snq; 


+  b 


3f 

2  5^ 


ipf  S  u(x,t)  .  (4-14) 


The  solution  of  equation  4-14  is  formally 

f (x, t j  Z)  -  G  *  u  .  (4-15) 

But,  u  *  -ipf  ,  so  that: 

f(x,t/Z)  -  G*  (-ipf ) 

-  -G*  (<p*  (G*u) )  (4-16) 

etc. 
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The  iterative  procedure  of  equation  4-1  f>  and  a  suitable  fixed  point 
theorm  can  probably  be  used  to  prove  tho  existence  of  solutions  to 

equation  4-14. 


CANONICAL  PROBLEMS  OKNSTEIN-UIt LENBECK  PROCESS 

Assume  that  the  target  moves  in  one  dimenu ton  with: 


b(x, t) 
a  (x) 


-Ex  ^ 

1  I 


and  tp  m  |jj  f  a  constant.  Then,  if  f(x,t;Z) 
w(x,t)  satisfies: 

3w 


w(x,t)e~^t  , 


5T  "  J  ^3  +  0  (4  (wx)  * 


Assume  that  w(x,0)  ■  6(x-x0>  .  Feller  (reference  5)  has  shown  that: 


w(x,  t) 


[— 

[  in:  (1-0 


tst; 


exp 


-B(x-x„e-”b 
— 


C  (1-G 


Remark 


All  of  theBe  problems  have  solutions  of  the  form: 


f  ~  wCXftle""'^  •  []term  due  to  target  motion]] 


x  [_term  due  to  search]) 
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APPROXIMATE  SOLUTION  OP  THE  STOCHASTIC 
SEARCH  EQUATION  IN  THE  GENERAL  CASE 


General  references:  1,  6,  10,  13,  14,  16,  17, 


Reconsider  the  stochastic  search  equation* 


9f 

n 


G  y-  _ _ 

5  ^  3x . 9x. 


3 

9 


(aijf)  -  a  ^7  (bif)  - 


with  initial  data* 


f  (x,  0; Z)  «  p q (x )  . 


(5-1) 


(5-2) 


For  simplicity,  assume  that  the  initial  data  is  exponential: 


P0(x) 


.-♦(X)/*2J  ekh.(x) 
k-0  * 


(5-3) 


Exercise 

Cohen  and  Lewis  (reference  13)  have  shown  that  the  following 
"trick," can  be  used  to  obtain  data  in  the  form  of  equation  5-3. 
Show  that  formally  one  can  set: 


<t>  (x)  «  - Efap q  ( x ) 

hQ(x)  -  1  (5-4) 

hk(x)  =  0  k  a  1  . 
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For 

P0<x) 


1 


-{Xj+Xj* /2n2 


find  <l>(x)  and  the  hk(x), 

Hints  Redefine  u  ,  In  terms  of  r . 


r>  -  n  • 


Based  on  the  solutions  of  the  canonical  problems,  one  seeks  a 
solution  of  the  SSE  in  the  form  (note  f  does  not  depend  on  Z(t)): 


f  (x ,  t ;  Z )  a  e  s;  ,  kg  .  (x,t*Z) 

k*0 


(5-6) 


In  this  equation,  i>(x,t)  and  g^(x,t»Z)  k  «  0,1,2,,..  are  to 
be  determined.  Equation  5-6  is  called  a  "ray  ansatz." 

Now  apply  the  following  procedure i 

Evaluate  3f/Dt,  3f/3x^  and  32t/3xi3x^  if  f(x,t;Z)  1b 
given  by  equation  5-6, 

2.  Substitute  into  the  search  equation  equation  5-1. 

3.  Collect  terms  according  to  powers  of  e  .  One  obtains* 


Q-<Mx,t)/^  1{  }  +  ,0{ 
c 


>+£*{  I  + 


0. 


k 

4 .  Set  each  coefficient  of  e  equal  to  zero.  This  gives  an 

equation  for  4?  (x ,  t )  if  k»-land  for  g^(x,tfZ)  if  k-0,1,2... 


(5-7) 
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Exercise 

Show  that  the  equation  that  4>(x,t)  satisfies  is: 


§1 

at 


+  1)  b 


i  ax 


1 

2 


V' 

i.j 


ij 


a  $ 

a  x^ 


a » 

3xj 


-  o 


Equation  5-8  is  the  "eikonai"  or  Hamilton-Jacobi  equation.  It  is 
first  order,  but  non-linear.  Let: 

H(x,p,t)  -  Tj  biPi  +  j  2l!  aijPiPj  * 

be  a  "Hamiltonian”  in  which  p  »  i®  a  new  independent 

variable.  Then  one  writes: 

5t  +  H(x'  lx  '  *)  "  0  * 

Equation  (5-8)  can  also  be  solved  by  the  method  of  characteristics , 
(references  14,  15,  and  16) 

Theorem  (reference  14,15) 


Let 

x(t)  and 

p-(t)  be  the  solution,®  of 

dx^ 

“IE 

_  3H 

V01  -  x10  J 

dpi 

“IE 

.  -  |JL  , 

Pi(0)  -  PiO  ). 

(5-8) 


(5-9) 


(5-10) 


(5-11) 
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Rxerc i jse 
1)  Assume  that! 


and  b^(x,t)  =»  ,  a  constant.  Write  down  nnU  solve: 

the  ray  equations. 

2)  Assume  that 

uij>  "  (n  l) 

and  b^(x,t)  *  (t.)  only.  Write  down  the  ray  equations. 

When  can  they  be  solved? 

3)  What  are  the  ray  equations  for  general  (a^)  and  b^(x,t)? 


Theorem  (references  14  and  15) 

If  the  solution  curves  of  equation  5-11  don't  intersect, 
than  “  ;H)/3xi  and  <j>(x>t)  ,  the  solution  of  equation  5-12,  is 
also  a  solution  of  equation  5-8. 


Initial  conditions  arc  still  needed.  In  light  of  equations 
5-3  and  5-6,  one  has: 

>J  «\(*>  -  . 

Hanca,  one  sets: 

x(0)  «  xrt 


Pi<°) 


<Mxq,0) 


ax] 


*<V 


Thus,  the  following  algorithm  can  be  used. 


ALGORITHM  FOR  SOLUTION  OF  THE  HAMILTON -JACOB I  EQUATION 


Ll 

Pick  xQ 

(arbitrary) . 

Solve: 

dXi 

.  3H 

xi<0)  « 

xi0 

dpt 

St“ 

H 

1 

h*t 

P^O)  - 

34> 

3xi 

X0 

h. 

Set  <j)  (x 

,0)  -  -  i(Xg) 

and  solve: 

H 

"  7  ^  aijpipj  * 

4.  Cycle  through  Xg  . 


5-13) 


5-14) 


5-15) 


(5-16) 
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ALTERNATIVE  ALGORITHM  FOR  THE  SOLUTION  OF  THE  HAMILTON- JACOB I  EQUATION 
The  following  alternative  algorithm  can  also  be  used. 

Choose  a  point  x  at  time  t. 


1. 

2. 


Find  the  point  xn  such  that  the  solution  of 


dx 


i 

3F“ 


3H 

3pi 


xi<0> 


iO 


3. 


4. 


dpi  .  .  bh_ 
clt  ax,^ 


P±(0) 


j asses  through  the  point  x  at  time 
Set  <t>g  ■  ‘Mx^)  an<^  solve 


t. 


&  •  I L'  ai:9ipj  • 

This  generates  <fi  (x ,  t )  . 

Cycle  through  x  at  time  t. 
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Variational  Interpretation  (references  6,  10,  14,  16) 
Define  a  Lagrangian  L(x,dx/dt)  by: 


+  H(x,p,t) 


(5- 


Exercise 

For  H(x,p)  given  by  equation  5-9,  show  that: 


L 


dx 
dt ' 


*) 


In  this  equation,  is  the  inverse  of 


‘“ij'^ij* 


-  G3- 


( 5' 


Let 


C{t,x}  »,  {set  of  all  paths  u(S)  with  u(0)-xo  and  u(t)-x} 


(see  figure  3).  Then,  according  to  Hamilton's  principle: 

Jt 

nin  / 

C{  ■ 


t 

♦  <*>«  -  C 4'  35'  Ts  ■ 


(5 


This  formulation  is  often  very  useful  for  numerical  evaluation  of 


Remarks 


1.  If  there  is  a  deterministic  trajectory  connecting 

(Xq,0)  and  (x,t),  then  L^x,  t^  vanishes  on 

that  trajectory. 

2.  If  Pq(x)  -  6(x-Xq)  then  the  p^'s  can  be  treated 
as  parameters  (see  reference  1  or  6). 

3.  If  p q (x)  is  type  3,  i.e.t 


P0(x) 


p  (x) 
0 


“«dtcdt 


X*D„ 


there  may  be  difficulties  with  the  ansatz  (equation  5-6) 
(i.e.,  rays  may  intersect  for  xQ  near  the  boundary 

I 

of  Dt) .  More  work  (boundary  layer  solutions  or 
uniform  methods)  can  eradicate  the  difficulties. 


Now  consider  gQ(x,t;Z). 

Exercise 

Show  that  g  (x,t>Z)  satisfies  the  following  equation! 


Sg0 

rr 


a  -il 

aH  a.. 


y>  l  ij.  $ 


1 

7 


‘ij  ?x 


ft) 


3b. 
i  3xi 


+  ♦ (x,t>Z) 


*0  * 


(5-20) 
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This  is  a  first-order  linear  differential  equation  for  gQ(x,tjZ); 
it  is  called  a  transport  equation.  Note  that  if  (a^., )  r  (0)  , 
then  equation  5-20  becomes  the  deterministic  search  equation, 

To  solve  equation  5-20,  recall  that: 


i  „  an  „  h  .  v  _  941 

arr  V  L‘  aij  rt 


(5-21) 


Then  equation  5-20  becomes: 


"o  „  v  dxl  5go 


5T"  +  ^  dtT  oix^ 


M  v*? Pj  +  * *ij  0~ 


i3xj/ 


3b. 

+  EJ  g0  . 


Thus,  on  the  rays: 


•  -  jr  (t)  +  i|^x(t),  t,  zj|g( 


(5-22) 


(5-23) 


In  this  equation: 


f(t)  "  Pj  +  *  aij  y5iy^j)+  i 


(5-24) 
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An  alternative  formulation  is  obtained  by  following  referenoe  6. 
Let  J(t)  satisfy: 


dJ 

as 


V  i_ 

\  3xi  ‘ 


Then  equation  5-24  becomes: 


T(t)  - 


2  J 


1  dJ  ,  1  v  36  ,  v  3bi 

^  7  i ,  j  **1  i  ' 


so  that  3  2<t>/3>c^3Xj  does  not  have  to  be  computed. 


Remark 

Ludwig  (reference  6)  interprets  J  as  the  Jacobian 
of  the  transformation  from  physical  to  "ray  space." 


Initial  Condition 

Prom  equation  5-3  and  5-6,  it  is  clear  the  the  appropriate 
initial  data  is: 


g0(x0,0»Z)  -  hQ(x0)  . 

The  other  functions  gk(x,t;Z)  are  determined  in  a  similar  fashion. 


5-25) 


5-26) 


5-27) 
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SUMMARY  OP  COMPUTATIONAL  ALGORITHMS 


In  this  section,  three  algorithms  are  given  for  the  solution 
of  the  three  search  equations  corresponding  to  different  types  of 

target  motion. 


DETERMINISTIC  TARGET  MOTION 
Equation! 

a 


Sf  . 
oT 


-  £ 

i  UAi 


5x7 


-  <l>f 


f(x,0;Z)  » 

pC 

!  (X) 

Algorithm 

Pick 

x. 

2,  Solve 

dx. 

0 

XT’ 

bi 

(x,t) 

3.  Solve 

- 

df  M 

v  9  b 

It 

L 

i  ““ 

with 

f  (0)  - 

4,  Cycle 

to 

1  or 

xi(0)  »  x 


Tx‘ 


P0(V 


iO 


+  iji  ( x  ( 1 5 ,  t ,  Z ) 
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*^* * **^ ^*-'* ^^*^***  ■---■-- 


CONDITIONALLY  DETERMINISTIC  TARGET  MOTION 
Equation t 

H  -  -  =  5^  (bit)  *  *£ 

f(x,0;Z)  -  pQ<x) 

b  (x « t)  drawn  from  a  distribution  B(bJ  . 
a  a 

Algorithm 

jL  Fix  a  and  let  f(x,t>Z|a)  denote  the  solution  of  (1) 

with  a  fixed. 

Obtain  f(x,t;Z|a)  by  using  steps  1  through  4  of  the 
previous  algorithm. 

Calculate: 


2. 


3. 


f(x,t»Z)  »  E{f(x,tjZ|a)} 


-  /«(*. 


Bib,) 


t>z|a)dP  . 


a 


STOCHASTIC  TARGET  MOTION 


Equation » 

3  f 


5t  “  f  ^  SxpxJ  (aijf)  “  ^  <bif) 


f(x,0;Z)  ■  e“$(x)/e  2  e^hk(x) 

k-0  K 


-  i|j  f 


(1) 
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Algorithm  for  f<x,t>Z)~  Q-<j>  (x,  t)  Ag^  jx  ^  t .  z) 


A 

2. 


Pick  x  at  t  ;  find  x,. . 

0 


Find  p 


if) 


2* 

ax' 


x<»x, 


3.  Solve  the  ray  equations! 

dXj 


1 

at" 

aPi 

arr 


a  h 
aPi 


3H 

ax' 


*i<°> 


Pi  (0) 


ki0 


'i0 


where 


H(x,p,t)  «  S  bipi  +  j  2  aijt3iPj 


4u  Solve  for  <f>  s 

M  ■  5  S  "ijPjPj 


<M0)»  4> (xQ ) 

o 

5.  Evaluate  the  Jacobian  J(t)  or  calculate  3  (Jv/ax^x^ 

6.  Solve  for  gQj 

dg0  T  I 

g-£-  *  -  [r  (t)  +  1(1  (x,t,Z)J  g0 

go(V0#z)  “  h0(x0) 

7^  Cycle  to  1. 
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OPTIMAL  SEARCH  FOR  A  MOVING  OBJECT 
General  References:  2,  3,  17. 

■  i 

In  this  section,  the  problem  of  optimal  Bearch  is  formulated 
and  a  method  of  solution  is  sketched . 

Let  C(Z)  be  the  set  of  allowable  search  paths.  For  example: 


C{  Z } 


fz(t) :  Z(0)»z0,  Z(Tf)-z 


!f' 


dZ 

d2ii 

dt 

»s  v, 

s? 

a} 


(7-1) 


is  the  set  of  search  paths  with  constrained  endpoints  and  constraints 
on  velocity  and  acceleration. 

Three  possible  objective  functionals  are  the  following. 

(Other  functionals  could  be  used.) 


FUNCTIONAL  #lt  INSTANTANEOUS  PROBABILITY  OF  DETECTION 
Let: 

,  J1(Z,t}  -  ExOMx,t,Z)}  (7-2) 


-/ 


<|>  (X,  t,  Z)  0  (x,t  j  Z)dX 


Note  that  j^{ Z , t)  is  the  (averaged)  instantaneous  probability  of 
detection.  A  search  plan  that  maximizes  J ^ { Z , t }  is  called  myopic . 


(7-3) 

i 


From  the  definition  of  p(x,t|Z) 

Z) f (x,t»z)dx 


one  obtains  that: 


JjUrt} 


(x,t, 


7 


f (x,t>Z)dx 


(7-4) 
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Whan  J^(Z,t)  is  extremized,  one  has  the  following  interpretation. 
Consider  an  interval  (0,T) .  Divide  it  into  k  subintervnls  , 

(ti»  fci+1)  with  tQ  »  O  and  tk  *  T. 

Next,  maximize  Jj^Z,^}  for  i  -  l,2,...,k-l.  The  optimal 
path  ia  the  piecewise  linear  set  j^Z0,  ZjJ  ,  [^Z ^ ,  etc.,  where 

Z£  -  Z(ti). 

As  k-*«  ,  a  continuous  curve  z*(t)  is  obtained. 


FUNCTIONAL  »2i  PROBABILITY  OF  DETECTION  BY  TIME  Te 

s 

Let 

J2{Z,Tg}  -  1-  /f(x,VZ)dx  .  (7-5) 

This  functional,  J2{Z,Tg}  ,is  the  probability  of  detection  by 
time  Tg.  One  seeks  the  path  Z*(r)  ,  0  *  x  *  Tg  that  maximizes 

J2{Z,Tg}  .  Also,  note  that  f(x,t»Z)  satisfies! 


£.  v  3 
2  iTj  3Vxj 


<aijf) 


-  s  5^  (bif»  -  **  • 


(7-6) 


In  terms  of  control  theory,  this  is  an  optimal  control  problem  for 
a  distributed  parameter  system  with  control  in  the  coefficients. 
There  is  essentially  no  theory  for  this  sort  of  problem. 
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FUNCTIONAL  »  3t  MEAN  TIME  TO  DETECTION 


The  probability  density  for  the  time  of  detection  can  be 


determined  as  follows.  Let  Tp  be  the  total  time  available  for 
search.  Let  h(t)dt  ■  Pr{detection  occurs  in  (t,  t+dt) }  .  Them 

r 

f(x,t?Z)dx  t  x  T* 


Let 

h(t)dt 

h(t) 

3 

,rn 

/f 


t  >  T,  , 


rF 


(7-7) 


is  the  desired  probability  density. 

The  mean  time  to  detection  is  them 
T_ 


•M 


z>  -  / 


th  (t)dt 


(7-B) 


t£~  /f(x,t,Z)dx]dt  . 


(7-9) 


SOLUTION  OP  AN  OPTIMAL  SEARCH  PROBLEM 

Consider  now  the  problem  of  finding  Z*(t)  €  C<  2 )  that 
maximizes  J2{Z,Tg}  .  In  order  to  make  any  progress,  the  functional 
will  be  converted  to  a  function  as  follows.  The  functional  J2(Z,t} 
can  be  rewritten  asi 


J2(Z»t) 


i  .y  0“<ti  (x,  t)/c^  e*gk(x,t,z)dx 
1  -  S  eky*e“^:x,t>/Egk(x,t>Z)dx 


(7-10) 


-  1  -  E  ek,I.  (Z, t)  . 

k-0  K 


(7-11) 
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The  integrals 


Ik(Z,t)  ata  defined  by: 


Ik(Z,t) 


t )  / 


q  ( x  ,  t. ;  X )  d  x 
k 


( 7-  1  2 ) 


These  integrals  can  be  analyzed  by  Laplace's  method  (reference  17). 

Let  x*(t)  denote  the  minimum  over  DT  of  <Mx,t).  For 
simplicity,  assume  that  there  .is  only  one  minimum.  from  reference 
17,  page  338,  one  has  that: 


Iku,t)  ~  )/r.  (2,r)n/2 


A,;°k0 


1*0 


1  2 


1*0  rj 


(7-13) 


In  this  equation,  n  a  2  or  3  is  the  dimension  of  the  space  in 
which  the  target  moves.  The  variables  ate  now  coordinates 
(reference  17,  page  3.34), 


and 


G 


gk(x*(t)  ,t,z) 


k0 


detl 


ili  \ 

3xi3xJ 


tT 


xMt) 


(7-14) 


(7-15) 


It  is  often  sufficient  to  use  only  the  first  one  or  two  terms  of 
the  full  asymptotic  expansion, 
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““•‘n-iitfi  |i 


.Lx  - fiW  I ^  j 


Thu*,  J2(Z,Tg}  has  now  been  converted  to  a  function,  rather  than 
functional : 


J2t2,Ts) 


n/2  -♦(X*(T.),T  )/e 

(2  ',;i  fr . )  n '  *  e  S  S 


One  now  determines  the  function  Z*(t)  that  maximizes 
equation  7-14  on  [[0,  Tg^  •  Here,  Z(t)  occurs  in  the  Gk0  -terms, 
which  depend  on  gk(x,tjZ)  by  equation  7-15,  and  the  dependence  of 
g^  on  Z ( t)  is  given  by  equations  such  as  5-23. 


Remarks 

1.  It  is  still,  in  most  cases,  necessary  to  use  a 
computer  to  obtain  Z*{t)  .  However,  by  going  from 
functional  to  function,  the  amount  of  work  required 
has  been  vastly  reduced. 

2.  It  may  be  possible  to  solve  some  of  these  problems 
by  "dynamic  programming," 
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APPENDIX  A 

SOLUTIONS  OP  EXERCISES 


In  this  appendix,  written  by  James  Thomas,  Jr.,  the  solutions 
of  most  of  the  exercises  are  given. 


EXERCISE: 

— . .  - 

6  (S) 


lim  @-S2n/2 


lim 

n-*-°° 


'n 


(S) 


with  en(sj 


/r  a-S2n/2 
/5tt 


Sketch  a  few  £ n(S) . 

Sketch  the  corresponding  5^(S)  ,  where  the  prime  indicates  a 
derivative  with  respect  to  S  . 


SOLUTION: 

Refer  to  the  following  computer  graphics. 


EXERCISEi 


Show  that  for  deterministic  target.  motion: 
varf  AX |  X  (t)  *x  I  «  G. 

SOLUTION: 

For  deterministic  target  motion,  the  transition  function, 
q(f„,t,At,x)  is  given  by 

q (£ , t, At,x)  ~  <$  (£  -  b  ( x ,  t )  A t )  . 

Substitution  of  this  in  the  expression, 

E{  (AX)  2 }  -  J  r.2qdr,  , 

yields 

e{  (ax)2}  ■  j’  ry2s  (f,-b(x, t)At)df;  =  [_b(x,  t)  J2  (At)2. 

Consequently, 

var{AX}  »  E{(Ax)2}  -  [_E<AX>112  *  0  • 


For  stochastio  target  motion,  given  x(t)  ■  x  ,  AX  is  distributed 


with  mean 


b(x,t)At  +  o  (At) 


and  covariance 


where 


ea^  j  (x,t)A  t  +  o  (A  t)  , 


oJAJlL  .>  o  as  At  0  . 
A  t 


Alternatively! 


E{AXi  |X(t)-x}  -  bi(x,t)At  +  o  (A  t) 

E{A  X^A  Xj  |  X  ( t)  “x}  -  ea^A  t  +  o  (A  t) . 


EXERCISE! 


If  AX  is  normally  distributed,  what  happens  as  e+0  with 
a^j  bounded?  Write  the  alternative  conditions  for  stochastic 
target  motion  in  terms  of  q  . 


i 


nasBEBsasssaai 


.  ..  ■  -pm  ,  | 


SOLUTION t  Let  dX  ■  X (t  +  dt)  -  X(t)  . 

In  several  dimensions, 


q  ({]  ^ ,  K  2  >  •  •  •  ,  C  ^ t ,  cil,  x )  d/.  ]  df,  '■)•••  d£  ^  A,  j 
-  ProbU  1sX1  (t+dt)-X1  (t)  *{,  .,+df;  .j  ,  f,  2sX2  (t+dt)  -X2  (t)  <2+d£2, 

f,  isXi(t+dt)-Xi(t)sf,  i+dC  ^  K  jSXj  (t+dt)  -Xj  (t)  rf,  j+df,  ^  |  X(t)«x}  . 

If  two  new  functions  are  defined  such  that 

*  J  •  •  •  J  df,  ^d^2«*»df,  •••/£  £,^j»t,dt,x) 

and 

(^i»t,dt,x)  *  J1  •  •  •  j*d  ^  2  *  *  •  d  £  ^  ^  ^  d£  ^  q  ( f]  ^ £  2 ,  *  •  •  ,fj^,f»^,t,dt,x) 


then  the  alternative  conditions  for  stochastic  target  motion  can  be 


written 


E{dX^  |  X  ( t)  «x }  »  bi(x,t)dt  +  o(dt) 

-  J*  d5iqi(C,t,dt,x)Ci 


EtdX^  dXj|X(t)»x)  *»  ea^jdt  +  o(dt) 


J‘J  dCid?;jqij(5i^j,t,dt,x)f,i5:)  • 


Now,  given  that  dX  is  normally  distributed  with  mean, 


And  covariance, 


ea^j  (x,t)dt  +  o{dt)  , 


j « t,atf  x) 


•  exp 


piT^ea^  jdt+o  (dt>3 

f  CCi"bidt-o(dt)X^~bidt“°<dtO 

( - ^rea^EToWj - 


As  e+0  with  bounded,  qi;j  yt,dt,x)  becomes  a  delta 

function  analogous  to  the  Sn<S)  of  the  first  exercise,  consequently, 
the  target  motion  becomes  deterministic  in  X  ,  i.o., 

dXi  “  b^^xft)dt  with  probability  1  . 


A -7 

I 


EXERCISE* 


For  one-dimensional,  target  motion  with  dX~N  (b  (x,  t)  dt.  +  o(dt) 
ea(x,t)dt  +  o(dt)),  show  that 

j5nq($,t,dt,x)dF,  -  o(dt) 


for  n  it  3  ,  where 

o  as  dt  •+  0 


SOLUTION i 

For 


dX~N(b(x,t)dt  +  o (dt)  >  ea(x,t)dt  +  o(dt))  , 


q  (5 » t ,  dt ,  x)  » 


r~r.-b(x>t)dt-o(dt)''1 
2[]ea(x»t)dt+o(dt)]] 


/2ir[]ea  (x,t)dt+o  (dt)J 


For  convenience,  let 


q  (f, ,  t,dt,  x) 


-Ul”B 


m2 


2  A 


/2ft  •  A 


with 

and 

Now 


A  •  ea  (x ,  t)  dt+o  (dt) 
q  m  b  (x ,  t)  dt+o  (dt)  . 


;Cnq(C,t,dt,x)d5 


1 

/JirA 


dC 


Making  the  change  of  variable  , 


5  "  B 


J«nq(5#tfdt,x)dC  “ 


-A—  [\y  +  B^f  e  ^ 
/17a  jL 


dy 


4 


-A—  JCy^Bny"*1^2  yn‘2+...>  W  dy, 

/27A 


for  which  only  the  even  power*  of  y  are  non-vaniahing . 
For  n  event 


4 


renq(5,t,dt,x)d*;  -  -Lr  JCy^B2  yn’2+...>  dy 

/2irA 


-  iK^)Hn/![i  +  w*  •••] 


,n/2 


M")n/2(dt) 


n'/2+tarma  of  higher 
order  in  (dt)  . 


Thua,  ,f5nq(£  ,t,dt,x)d5 
For  n  odd  t 

J'5nq(£*t,dt,x)d5 


o (dt)  for  n  even  a  4. 

_i_  JCnBy"-1^3 
/ITa  J  6 

,(n+l)/2  /n-f  2\ 

2 -  rf£jAjb*(ea)  2  (dt)  2  -fterma 

^  higher  order  in  (dt) 

A -9 


dy 


( 


EXERCISE: 

Suppose  that  there  is  no  search.  Let 

p(x,t)dA(x)  «  ProbfX (t) edA (x)  }  . 

What  equation  does  p  satisfy? 


SOLUTION: 


p  (x,  t+dt)  -  J’q(£,t,dt,x-£.)r  (x-£,t)d£. 


«iEj55^  (qe)] 


where  qp  -  q<5_,t,dt,x)  p(x,t) 


2 


Thus, 


p(x,t+dt)-p(x,t)  »  -E  pQb^tx^Jdt  +  o(dt)H 

‘u 


4i^^^(x,tidt  +  o(dto. 


Dividing  by  dt  and  taking  the  limit  dt+0  , 


ft  +  ?  3*1  (biP)  ‘  *  i^j  3xi3Xj 


p) 
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EXERCISE j 


I>’or  deterministic  target  motion,  show  that 


;)  f 

at 


;  -  (i).  n  -  .if . 

t  ,,34i  1 


SOLUTIONS 

For  deterministic  tarqot  motion,  f.*-0  in  the  stochastic 
search  equation  with  bounded. 

Search  equation  becomes 


2-f-  «  ff  -  1)  rr~-  (b,  f)  . 

i)  t  i  "3‘i  1 


This  result  is  also  obtained  by  settincj 


qtf. 


r. ,  t  ,dt ,  y )  *  -  b(x,t)dt) 
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EXERCISE: 


Suppose  that  b^(x,t)  =  v^(t)  .  Show  that 


f  (x,t?Z)  »  p, 


f  -Jo  v,S>dS) 

xp  “  /  'J'jx  -  /  v  (S  '  )dS  '  ,  S;  B]dS 

_  *A)  \  / 


Write  down  the  integral  that  gives  the  probability  of  detection 
by  time  t  . 


SOLUTION: 


If  bi(x,t)  »  v^ft)  i  “  0  •  and 


f  ( x ,  t ;  Z ) 


Wtraj  xexP  -/  (*  *  X  rxf) 


becomes 


f (x, t>  Z) 


°0  ^xobiaj  x  exP 


Jo  '  s'  z)' 


dS  . 


Xq  +  J  v(S')dS'  , 


x  -  (  v  (S)  dS  =>  x  -  (  v(S' 


)  dS '  . 


EXERCISE: 


Let  f(x,t)  «  w{x,t)e”^lt  .  Show  that 


9w 


32w 


St  2  ^  6ij 


y>  y*  3W 

i  1 


and  w(x,0)  -  pq(x) 


SOLUTION  t 


Given  f(x,t)  -  w(x,t)e  , 


||  .  |we-*t.jK(x,t)0-n 


For  -  6^  and  bi  constant, 


becomes 


it 

St 


af 

ST 


E  v'  v 

2  3xi3xj  '"ij 


“'j£)  ‘  f  <bif) 


1 ft  sii  -  ?  bi  Slj  - 


m  •-*  -  *«• 


-  ijif 
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Thus, 


£ 

2 


%' 

4-/ 


a2f 


id 


Sx, 3  x , 

i  D 


-  ?  bi 


3f 


.  2 

£  v  a  3  w 
2  j  ax.ax . 


and 


3w 

5t 


£  >'  <5  3 2w 

?  i^j  3xi3xj 


Also,  pQ(x)  »  f  (x,  0)  ■  w(x,0) 
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EXERCISE} 


.1  • 

I 


In  two  dimensions,  w(x,t)  -  G  (x-£  ,  t)  pn  £  )d£,  with 


a(K-£/t)  - 


i . ...J . — 

Fret  ftxp  Tzl -  • 


Assume 


nx2)2t(x1)2'] 

i  .  Li?  J 


P  (X)  -  - -  e 

u  2-na 


Find  w(x,t) .  HINT*  Gaussians  are  alosed  under  convolution. 


SOLUTION : 


w(x,t)  -  ya(x-s  ,t)  P0(5)d5 


-  xdc  2 


27ET;  exp 


(x1-bit-C1)2+(x2-b2t-€2)2 


.  1  0.c_  (52)2+^!)2 

'  y  QXp  “  . .  ■■■  m  <  ■ 

2tra  2a 


i  /  T  <*rV-«i»2  <h>2 

7“p  ’  - 

■ 

f _  (x2"b2t“52)  2  <£2)  2  ji ». 

J  eXp - ET - JT“  d^; 
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g  85E3B  S£  3S  " 


»*w w.1! w 1  ♦ 


<xl“blt’^l)  =  (f’l)  "  2(x1"blt)f:l.  +  (xrblt} 


(X1-b1t-51)2'  2  (<rZ+rt )  (r,)2-4g2  (x^  t)  f  j  +2(7*  (Xj-b.t) 


/2  (CT  +e t)  5t 


4a  et 


/2T  az  2c  et (x^-bjt) 1 


(a  +nt) 


(o  +et) 


4  a2  f.t 


Consequently, 


*  [  (x,-b,t-f;.)2  (S,)2 

Ht . . . jV  * 


exp(  - 


/2'  (c2+et) 5^-/1  aZ(x1-b1t)  (x]-bitb 

V^'  >&?+«>  2l°2+et) 


(x.-b.tr  /*  •  ] 

exp  -  — - fd£,  exp<- 

2 (O^+Gt)  ^  X 


/2  (a2ti:t)^-/?  a2(x1-b1t) 

yj-in2cl  V(tf2'‘-&t) 


[  (xl“blt>  V*2a2€t"  A-y2 

exp  -  — =tj -  —  is  ay 

I  2{a  +et)  V(a2+et)  ' 


EXERCISE  t 


Consider  the  one-dimensional  equation, 


w(x,t)  ■ 


/  2  ir  t 


=rj‘ 

£  t  A 


“(^e-fx-ht-O  V2bt  d- 


If  1/21  ,  use  integration  by  parts  to  derive  an  expansion 

fori  W(x,t)  . 


SOLUTION t 

Substituting  in  for  p(£)  gives 


w(x, t) 


/a  Tret 


£ 


1  ^  I  ,-Wt-CI‘Wjj 


/2irVt 


/ 


e“  (x-bt-U  /2ct 


5)  /2et 


/2'fT  E  t 


e-(x-bt-aV2Ct  ^ 


<* 

-i 


0-(x-bt-OV2et  d5 


/. 


-st. 


e“  (x-bt-5 )  /2et  d5 
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— l/STTt  -  / 

/2netl  *'£ 


_  _j  e-tx.bt<)2/xtaK.^\-lx-bt-i.)2/ict( 


/2iret 


00 

-J.  V-w-t: 


j|  e-(x-bt-C)  /Set  I  * 


e  t  d  (x-bt-C )  /2ct  ^  1 

+ (x-TTt-rr  ar  j_e  J  ^ 


Now  integrate  by  parts 


1  .-r—r  Gt  (x-bt-J)  z/2ct 

w(x,t)  -  -===  /2-net  • 

/*7TE  t 


/  _st  .-(x-bt-n  /»«*«*  .  7-Hnr  . 
(x-bt-O 


et _  -  (x-bt+J,)  /2et 


rl 

J 

*£*>  (x-bt-S 


-(x-bt-0  /2et, 


Now  repeat  the  process. 
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pn:  iTggj-^watbpr'r.liwrrfa  y^ngHC’  I 


EXERCISE: 

For  Bolution  of  the  search  equation  taking  the  form, 
f(x,t)  -  g(x,t?e)exF0-<Mx#tje)3  , 


pick  g(Xftie),  <Mx,trc)  and  find  the  b1  necessary  to  satisfy 
the  search  equation. 


SOLUTION: 

This  is  an  audience  participation  problem.  It  would  defeat  the 
purpose  to  give  a  worked  example. 


1 
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*,.<  Tf 1 1 1 1 ¥iiijHT r¥iilT¥iri iMff 


EXERCISE  I 

Using  the  ray  ansatz, 


f  (x, tj  z)  -  j  J)q  tkgk(x,t>z}|e"<1>(x't)/e. 


The  equation  for  <Mx>t)  is  obtained  by  setting  the  coefficient  of 
i  e~^c  obtained  from  the  soarch  equation  equal  to  zero.  Show  that 
this  equation  is 


H  +  5  bi  “r + 1  A  >i3(!1i)(r 


i  *  9xJ 


SOLUTION i 

The  search  equation. 


i,j  \3xV\9x 


3f  . 

n 


8  (*44  *> 


-**  -  ?  A  <v>  + !  &  ts# 


is  written  equivalently  as 


3f  _  e  v,  .  rf 

«  5^,  11  53^ 


I%*  ?fb*  ' 


+  *f  [ft) 


e  s-  /  ^“ii 

’ *  y 
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>j*r 


EE9E 


and  tha  ■•arch  equation  beaomea 
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li 


One  now  equates  terms  with  the  same  power  of  e  .  The  equation 
for  <Mx,t)  is  obtained  by  looking  at  terms  involving  1/e  « 


-(i4\  q  i  e~^F-  m  vj  lil  g  I 

\at/  *0  c.  B  2  g0^3xJ\!)X^  t 


rW  e 


?  bi(^) 


g0  e  e 


1  ”<t>/e 


This  yields 


^  +  («r) 


the  desired  result. 


EXERCISE i 


What  oquation  does  gg(x,tizi)  satisfy? 


SOLUTION t 

This  is  obtained  by  looking  at  the  terms  involving  e^i 


A- 2  5 


ill  itfl 


rjl/c 


Upon  rearranging  terms,  one  obtains 


(The  term  in  braces  is  the  left  hand  side  of  the  equation 
just  obtained  for  <|>  .) 
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EXERCISE i 


Assume  *  6^  and  b^(x,t)  *  b^  ,  a  constant.  Write  and 

solve  the  ray  equations. 


SOLUTION! 

The  ray  equations  are  the  following: 


dxi 

gr¬ 

.  liL 

aPi 

with  x^(0) 

"  X10 

and 

dpA 

<Jt“ 

■ 

• 

OMO, 

j*r 

with  p^(Q) 

o 

a 

■ 

where 

H (X|p) 

■  f  bi"i  +  i 

£  “i3pipj  • 

For  a 


ij  "  5ij  ' 

H(x,p)  ■  £  (biP1  +  J  pj) 


Now 


and 


dxi  „ 

Jt  ap , 


dpi 

at” 


_aH 


bi +  Pi 


0  . 


The  second  of  those  yields  the  solution,  pi  (t)  *  p,0 
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Then,  integration  of  the  first  yields 


xi(t)  -  xi(0) 


f0  <bi+E,i)d'-' 


:vi;txa 


'  I 

(hi+PiiH  • 


.  t'i  fl.MI.U  ■  A 

r 

..i;  t  '.>7.run 


and  consequently, 

xi(t) 


.  MpJ  TUilOfci 


“iO 


(bi+^,0)-t. 


i  .*  i,  od.J  fine i '7  I'niT 


These  rays  are  simply  stra.ia&t.-.lj.»psx  dtiw 


>i  i  1 
\  !* 


bnt. 

.  ■ ,  r*. 

*»  \  • 


•"»  :t ...  .'.iW 


EXERCISE: 


Assume  a^j  *  6^  and  that  b^(x,t)  is  a  function  of  t 
i.e.,  b^(x,t)  -  v^(t)  .  Write  the  ray  equation. 


SOLUTION* 


For 


RAY 

EQUATIONS 


H(X,p) 

a  V 

i 

bipi  +  I 

S  jPjP.i 

i/ j  13  1  3 

"  6ij 

and 

bi(x,t) 

"  vi(t)  , 

H(x,p) 

=  S 
i 

■ 

vi(t)pi  + 

1  n2l 

J  piJ  • 

dx, 

ar-  " 

3H 

ZpL 

-  Pi(t) 

+  vi(t) 

dp, 

art”  “ 

3H  n 

■  5x7  0 

Pi(t)  -  pi(0) 

X^^  (0)  -  X 


10 


Integrating  the  equation  for  x 

.t 

'0 

and  consequently, 


i(t)  -  xi(0)  ml  [p^(t  ')  +  Vt(t')jdt'  , 


*1  -  *10  +  <>10  *  +£  v-i<f)dt* 


only, 
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EXERCISES 


What  are  the  ray  equations  for  general  a^fxjt)  and  b^fx.t) 


SOLUTIONS 


For  aij(x,t)  and  b^Xjt)  generally, 


H(x,p)  «»  S  bi(x,t)pi  (t)  £  ai j  (x, t) p^ (t) p j  (t)  , 

i  i  >  j 


and  consequently, 


3H 


-  b^x.t)  +S>1j(*.t)Pj 


(t) 


and 


,{*M  . 


i 


The  ray  equations  can  be  written 


and 


dxi 

arr 


dpi 
dt ' 


3H 

¥p7 


9H 


b^^t)  +  £  a^  (x,t)Pj  (t)  > 


_  v 


^  pi(t)^j  "  \  i^j  pi{t)p 


xi(0) 
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EXERCISE: 


The  Lagrangian  L 


(*•  d4 


(«<  if) 


is  defined  such  that 
dx , 


+  H(x,p)  «  Tj 


V  dt  ’  pi 


Show  that 
L 


where 


(*d) 


,J«  J. 

is  the  i,j  element  of  the  inverse  of  the  matrix 


SOLUTION: 


and 


Now, 


H  (x ,  p)  * 

U  b. 
i  1 

p±  +  i  U 

1  2  i/j 

aljpipj 

dx^ 

3t“ 

9H 

*pl 

-  b<  +  D 

j 

aljpi 

dx . 

ar- '  bi 

“  D 

j 

aijPj 

can  be  written  ae 


6 "  -)1  ’  (r-=‘^  4 
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where 


dx  \  th 

“  b is  the  i  row  of  the  nx.l  column  matrix, 

the  elements  of  which  are  the  components  of  the  vector  (ats-s)  • 
QjijH*  £  is  the  product  of  the  nxm  matrix  with  elements 

aj_j  and  the  column  matrix  (nxl)  whose  elements  are  the  components 
of  the  vector  £  . 

Since 

(ai  -  fa)  -  L'lij'J  •  e  » 

-1  /dx  \ 

e  -  LA±j  J  *  ' 


where 

[a.  .t1 
-i 

is  the  inverse  of  the  matrix  f_a  . 

Now 

/  i  /dx  \\ 

Pk  “ 

(CliiT1  •  (si  -  nil 

ut 

?  (t4i3:]'1)kI  (tr  '  b»)  ' 

where 

(c?ljj 

•  1  1  i»  U 

J  is  the  k,t  element  of  the  matrix  that  is 

/  kSL 

the  inverse  of  the  matrix  C®ijU 
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Turning  to  the  Lagrangian, 


dx, 

V  dt~  *  pi  “  H(x'p) 


?  bipi  +  z  aijpjpt 

i » j 


dx . 

^  3tT  pi 
J  aijPiPj 

r  •  tjj^p  *  {E' 


bipi 


a 


H(x,p)  * 


> 


where  (p)Tr  is  the  lxn  row  matrix  obtained  by  taking  the 
transpose  of  the  nxl  column  matrix  (p)  . 
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